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FOREWORD 


In  September  1990,  the  Department  of  Defense  Inspector  General 
(DoDIG)  released  its  final  report  entitled  Audit  of  Nonconforming 
Eroducts  Procured  bv  the  Defense  Industrial  Supply  Center.  In 
the  report,  the  DoDIG  found  an  excessive  number  of  items  which 
did  not  conform  to  design  specifications.  The  DoDIG  claimed  such 
high  rates  were  attributed  to  an  inadequate  Department  of  Defense 
(DoD)  Quality  Assurance  Program  which  "... lacked  the  support  of  a 
DoD  policy  that  would  use  laboratory  testing  as  a  principal 
quality  assurance  tool . " 

Defense  Logistics  Agency's  (DLA)  Logistics  Management  Division, 
Directorate  of  Quality  Assurance  (DLA-QL)  immediately  initiated 
actions  to  improve  DLA's  Quality  Assurance  Program  by 
estcdDlishing  a  program  of  laboratory  testing.  It  included 
increased  emphasis  on  inspecting  items  as  they  are  received  at 
depots,  monitoring  the  quality  of  depot  stocks,  and  verifying 
conformance  of  items  before  they  leave  vendor  plants. 

Substantial  investments  were  made  in  new  in-house  laboratory 
testing  facilities  at  several  supply  centers  and  depots. 


DLA's  Quality  Assurance  Directorate  desired  development  of  a 
sound  approach  for  measuring  the  returns  from  its  investment  in 
the  laboratory  testing  program.  It  requested  support  in  this 
effort  from  DLA's  Operations  Research  Office  (DORO) .  This  report 
represents  the  initial  study  to  provide  that  support.  It  was 
prepared  under  the  guidance  of  Col  Levi  D.  Lowman,  Jr.,  USAF, 
Chief  of  the  Laboratory  Testing  Team,  and  currently  Chief  of 
Product  Conformance  Product  Definition. 


ector 
Policy  Integration) 
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EXECUTIVE  SUMMARY 


This  report  represents  an  initial  effort  to  develop  a  sound 
approach  for  measuring  DLA's  return  on  its  investment  in  its 
laboratory  testing  program.  It  provides  a  way  of  measuring  both 
investment  (costs  incurred)  and  quantitative  indicators  of  return 
(savings  and  costs  avoided)  broken  down  by  supply  center  and 
in-house  laboratory.  It  also  provides  initial  measures  of 
investment  and  return.  They  are  based  upon  data  on  DLA 
laboratory  testing  activities  (i.e.,  workloads,  costs,  etc.) 
obtained  from  supply  centers  and  DLA  in-house  laboratories  for  FY 
92. 

Investment  in  the  laboratory  testing  program  consists  largely  of 
DLA  labor  and  other  operating  costs,  equipment  depreciation,  and 
payments  for  testing  performed  by  non-DLA  laboratories.  Return 
is  more  complex.  It  includes  motivating  vendors  to  provide 
quality  parts  which  result  in  fewer  equipment  breakdowns  for  DLA 
customers,  thereby  avoiding  costly  equipment  repairs,  and 
improving  the  success  of  military  missions  (with  less  loss  of 
material,  equipment,  and  life) .  Return  also  includes  lower 
investments  in  inventory  and  reimbursements  from  vendors  who 
provide  nonconforming  products.  Use  of  DLA  in-house  laboratories 
collocated  with  supply  centers  reduces  test  cycle  times.  Use  of 
such  laboratories  collocated  with  depots  avoids  shipping  and 
handling  costs.  This  study  helps  to  show  whether  the  various 
returns  exceed  the  investments  in  lad^oratory  testing. 

The  terminology  used  and  availability  of  data  on  workloads  and 
costs  of  the  laboratory  testing  program  vary  greatly  between 
different  supply  centers  and  DLA  laboratories.  Nevertheless, 
reasonably  good  estimates  of  investment  can  be  made.  Estimates 
of  return  are  not  as  good.  Much  of  the  return  cannot  be 
expressed  in  quantitative  terms.  Moreover,  data  problems  prevent 
the  (quantitative  measures  of  return  from  being  estimated  in  a 
consistent  way  for  all  supply  centers  and  DLA  lodjoratories . 

The  investment  in  the  DLA  laboratory  testing  program  for  FY  92 
was  about  $12  million.  Quantitative  estimates  of  return,  within 
the  limitations  mentioned  in  the  preceding  paragraph,  are  $36 
million  for  FY  92.  Qualitative  indicators  of  return,  in  our 
view,  are  far  larger  and  more  important.  Thus,  the  total  return 
((quantitative  plus  (qualitative)  on  investment  in  laboratoiy 
testing  is  highly  favorable. 

DLA  should  consider  steps  to  standardize  terminology  and 
procedures  for  reporting  workload  and  cost  information  so  that 
activities  at  different  supply  centers  and  laboratories  can  be 
conpared  on  a  common  basis.  Measurements  of  investments  in  and 
returns  from  the  laboratory  testing  program  should  be  extended 
into  FY  93  and  beyond,  using  the  procedures  described  in  this 
report . 


V 


Because  of  the  recent  decision  to  fund  DLA  laboratories  on  a  fee- 
for-service  basis,  the  reader  may  be  tempted  to  try  to  use  this 
report  to  compare  the  economics  of  using  commercial  laboratories 
in  lieu  of  in-house  laboratories.  Resist  that  temptation!  The 
data  in  this  report  are  not  adequate  for  such  a  comparison. 
Moreover,  the  desirability  of  increasing  in-house  laboratory 
utilization  to  lower  unit  costs  are  not  examined  herein.  A  study 
of  the  economics  of  using  in-house  versus  commercial  laboratories 
will  be  instructive  when;  (a)  more  information  on  laboratory 
costs  and  returns  is  available,  (b)  there  has  been  some 
experience  with  funding  in-house  laboratories  on  a  fee  for 
service  basis,  (c)  relocation  of  the  in-house  laboratories  at  the 
Defense  Electronics  Supply  Center  and  Defense  Personnel  Support 
Center  (Clothing  and  Textile)  becomes  necessary  because  of  Base 
Realignment  and  Closure  1993 . 

In  conclusion,  based  on  this  study  it  appears  that  the  overall 
DLA  laboratory  testing  program  is  cost  effective.  Its  optimality 
cannot  be  determined  because  of  data  limitations.  As  the  program 
matures,  further  studies  to  improve  the  system  will  be  feasible 
as  the  quality  of  data  improves. 
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SECTION  1 
INTRODUCTION 

1.1  BACKGROUND 

DliA's  Quality  Assurance  (QA)  Directorate  (superseded  by  the 
Supply  Management  Policy  Group)  has  requested  development  of  a 
sound  approach  for  measuring  the  returns  from  its  laboratory 
testing  program.  In  response,  the  DLA  Operations  Research  Office 
(DORO)  prepared  an  Analytical  Services  Agreement  which  was 
approved  on  29  January  1993  (Appendix  F) .  This  report  was 
prepared  in  accordance  with  that  agreement. 

Several  problems  with  measuring  returns  were  apparent  from  the 
outset.  One  set  of  problems  concerns  defining  what  should  be 
counted  as  return.  For  example,  some  testing  is  mandated  by  law 
or  regulation.  Requirements  for  some  testing  are  so  obvious 
that,  although  not  legally  mandated,  failure  to  test  would 
constitute  gross  mismanagement.  Some  testing  seems  truly 
discretionary.  Clearly  the  requirements  for,  and  returns  from, 
the  various  types  of  testing  are  quite  different.  Complete 
elimination  of  laboratory  testing  is  simply  not  a  viable  option. 

Another  set  of  problems  concerns  obtaining  data  needed  to  measure 
returns.  Because  the  laboratory  testing  program  was  recently 
initiated  at  some  supply  centers  and  depot  regions,  the  various 
DLA  supply  centers  differ  in  the  types  of  testing  performed,  in 
the  data  collected,  in  the  use  made  of  laboratory  results,  and 
even  in  the  terminology  used. 

This  report  attempts  to  provide  a  reasonable  approach  to 
measuring  these  dissimilar  activities.  Admittedly,  the  approach 
is  based  on  several  key  assumptions.  Therefore,  use  of  this 
report  to  make  detailed  comparisons  (e.g.  of  the  effectiveness  of 
the  ledaoratory  testing  program  at  different  supply  centers  or  at 
different  in-house  laboratories,  or  of  commercial  vs.  in-house 
IcUaoratories)  would  be  unfair.  For  example,  the  report  does  not 
examine  the  desirability  of  increasing  in-house  laboratory 
utilization  to  lower  unit  costs  of  in-house  testing.  At  most  the 
report  should  be  used  to  evaluate  the  strength  of  the  overall 
program . 


1.2  SCOPE 

The  study  encompasses  the  laboratory  testing  program  at 
Headquarters  DLA,  5  supply  centers  (DCSC,  DESC,  DGSC,  DISC,  and 
DPSC{C&T))  and  5  DLA  laboratories  (DCSC,  DESC,  DPSC(C&T) ,  DDRE, 
and  DDRW) .  DPSC  (Subsistence)  and  DPSC  (Medical)  testing  were 
not  included  since  they  are  not  discretionary  and  do  not  incur 
out-of-pocket  costs  to  DLA.  Sxabsistence  testing  is  controlled  by 
the  Departments  of  Agriculture  and  Commerce.  Medical  testing  is 
controlled  by  the  Food  and  Drug  Administration.  The  photographic 
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laboratory  at  DGSC  was  not  included  because  it  was  not  opened 
until  October  1992,  after  the  close  of  FY  92. 

1.3  OBJBCTr/^.S 

The  study  has  three  objectives: 

Develop  a  methodology  for  measuring  DLA  investments  in  and 
returns  from  its  laboratory  testing  program. 

Develop  initial  measures  of  DLA  investments  in  and  returns  from 
its  laboratory  testing  program. 

Provide  DLA  management  with  the  capability  to  run  "what  if" 
simulations  on  the  financial  impacts  of  changes  in  workload 
levels,  use  of  in-house  versus  outside  laboratories,  new 
investments  in  laboratories,  expanded  or  curtailed  lab  testing 
programs ,  etc . 
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SECTION  2 
METHODOLOGY 


This  study  was  carried  out  in  accordance  with  the  study  approach 
described  in  the  Analytical  Seirvices  Agreement  between  the 
Directorate  of  Quality  Assurance  (DLA-Q)  and  the  Directorate  of 
Policy  and  Plans  (DLA-L) .  The  analysis  was  further  specified  in 
flow  charts  of  operational  processes  for  DLA  laboratory  testing. 
The  charts  were  submitted  to,  and  approved  by,  DLA-Q  on  ' 
February  1993.  They  are  shown  at  Appendix  D. 

Results  of  the  study  are  based  upon  data  obtained  from  supply 
centers  and  DLA  in-house  laboratories.  Most  of  the  data  pertains 
to  DLA  laboratory  testing  activities  (i.e.,  workloads,  costs, 
etc.)  during  FY  92.  However,  some  data  for  earlier  years  were 
obtained  and  used. 

DORO  initially  submitted  the  data  requirements  for  the  study  to 
DLA-Q  on  3  February  1993 .  DLA-Q  sent  letters  requesting  the 
needed  data  to  supply  centers  and  defense  distribution  regions  on 
12  March  1993.  Responses  were  sxibmitted  to  DLA-Q  for  review, 
then  forwarded  to  DORO  for  analysis.  On  4  May  1993,  an 
In-Process  Review  was  held  during  which  some  gaps  in  the  data, 
certain  data  anomalies,  and  some  misinterpretations  of  questions 
were  identified.  As  a  consequence  on  7  May  1993,  the  DLA  Supply 
Management  Group  (having  taken  over  sponsorship  of  the  project 
from  DLA-Q)  sent  follow-up  data  requests  to  the  Quality  Assurance 
directorates  of  supply  centers  and  defense  distribution  regions. 
The  responses  were  submitted  directly  to  DORO.  Any  necessary 
clarifications  generally  were  handled  telephonically .  This 
report  utilizes  the  responses  to  the  data  requests  of  both  12 
March  and  7  May. 

Appendix  E  shows  the  major  points  of  contact  who  furnished  data 
used  in  this  report. 


SECTION  3 

INVESTMENT  (COSTS  INCURRED) 


3.1  OVERVIEW 

This  section  describes  the  investment  in  DLA's  laboratory  testing 
program.  Investment  is  taken  as  equivalent  to  costs  incurred. 

The  subsections  which  follow  describe  the  categories  of 
investment  included  in  this  report.  The  summary  shows  estimated 
investment  for  FY  92  by  supply  center  and  DLA  laboratory. 

Appendix  A  shows  detail  on  how  these  investment  estimates  were 
developed  by  category  of  investment. 

3.2  LABOR 

This  category  represents  salaries  and  benefits  for  personnel 
engaged  in  the  laboratory  testing  program.  It  includes  personnel 
who  design  test  plans  and  monitor  laboratory  testing  at  each 
supply  center  as  well  as  laboratory  personnel  who  perform  the 
tests . 


3.3  TESTING.  NON-DIA 

This  category  represents  the  cost  to  DLA  supply  centers  of  tests 
performed  by  commercial  and  non-DLA  governmental  laboratories. 

3.4  TESTING.  OTHER  DLA  LABS 

This  category  represents  the  cost  to  DLA  supply  centers  of  tests 
performed  by  DLA  in-house  ledaoratories  that  are  not  part  of  the 
supply  centers  ordering  the  tests. 

3.5  OTHER  OPERATING  COSTS 

This  category  represents  operating  costs  other  than  labor.  It 
includes  travel,  tuition,  supplies,  equipment  operation  and 
maintenance,  other  maintenance,  etc.  It  does  not  include  non-DLA 
testing,  shipping  and  handling  costs,  or  material  destroyed, 
which  are  included  elsewhere.  No  allowance  is  made  for 
administrative  and  support  burden. 

3.6  lQm.Bmg..PBPRBCIftTIOT 

This  category  represents  capital  investment  in  equipment  usually 
depreciated  on  a  straight  line  basis  using  a  10  year  service 
life. 


3.7  SKEEPyLifflP  HftMPtiBag 

This  category  includes  the  cost  of  depot  handling  and  commercial 
shipping  of  items  shipped  from  depots  to  test  laboratories  and 
back  to  depots. 
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3.8 


This  category  represents  the  cost  of  material  destroyed  as  part 
of  destructive  testing. 

3.9  RBIMBURSBMBNTS.  NQW-DIA 

This  category  represents  reimbursements  provided  to  DLA 
laboratories  for  tests  they  performed  for  non-DLA  requesters 
(i.e.,  directly  for  the  Military  Services  or  other  Government 
Agencies) . 


3.10 


RE] 


SRMkrIfi'S . _ 


This  category  represents  reimbursements  provided  to  DLA 
laboratories  for  tests  performed  for  DLA  supply  centers  of  which 
they  are  not  a  part.  This  is  a  deduction  from  the  cost  of 
operating  those  Iciboratories .  For  DLA  as  a  whole,  the  amounts 
are  exactly  offset  by  the  charges  shown  under  Testing,  Other  DLA 
Labs  in  Section  3.4,  above. 

3.11  SOMMARY 

Table  3-1  provides  a  summary  of  the  measures  of  investment  for  FY 
92.  Details  are  in  Appendix  A. 


TABLE  3-1.  SUMMARY  OF  MEASURES  OF  INVESTMENT,  FY  92 


Activity 

Investment  ( $ 

DCSC 

$  1,377 

DESC 

2,846 

DGSC 

384 

DISC 

2,849 

DPSC  (C&T) 

3,059 

DDRE 

439 

DDRW 

183 

HQ  DLA 

_ m 

TOTAL 

$11,574 
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The  investment  measures  for  FY  93  and  beyond  are  expected  to  be 
significantly  different.  FY  92  was  the  first  year  of 
implementation  of  a  formal  laboratory  test  program  at  DCSC  and 
DGSC.  As  such,  they  were  building  up  during  FY  92  and  should 
have  higher  costs  in  the  future.  Investment  at  DGSC  should  be 
much  higher  because  of  the  opening  of  the  photographic  laboratory 
in  October  1992.  The  laboratories  at  DDRE  and  DDRW  also  were  new 
in  FY  92 .  As  they  develop  a  track  record  more  of  their  costs 
should  be  offset  by  reimbursements.  The  DLA  reorganization  has 
resulted  in  smaller  investments  in  the  laboratory  testing  program 
at  HQ  DLA.  Further  changes  are  expected  in  FY  94  when  the  DLA 
in-house  laboratories  become  independent  of  supply  centers  and 
their  funding  under  a  fee -for- service  arrangement  is  initiated. 


SECTION  4 

RETURN  (COSTS  AVOIDED) 


4.1  OVBRVIBW 

This  section  describes  the  methodology  used  to  calculate  the 
return  from  the  laboratory  testing  program.  Return  is  taken  as 
being  equivalent  to  benefits.  It  consists  primarily  of  avoidance 
of  costs  that  would  be  incurred  if  there  were  no  laboratory 
testing  program.  Some  types  of  cost  avoidance  can  be  measured. 
These  are  discussed  in  Section  4.2.  The  measurement  procedures 
are  illustrated  using  data  for  FY  92.  However,  the  measurements 
should  not  be  taken  too  seriously  as  good  measures  of  several  key 
variables  were  not  available.  Several  simplifying  assumptions 
were  made.  They  are  documented  in  the  footnotes  to  Appendix  B. 
Types  of  cost  avoidance  which  cannot  be  measured  are  discussed  in 
Section  4.3. 


4.2 


NATIVE  INDICATORS 


Measured,  or  quantitative,  indicators  of  return  are  divided  into 
three  categories.  The  first  two  are  programmatic.  These  are 
associated  with  the  laboratory  testing  program  independent  of 
whether  the  tests  are  performed  by  DLA  in-house  laboratories  or 
non-DLA  governmental  or  commercial  laboratories.  They  measure 
costs  avoided  as  a  result  of  testing  ordered  by  supply  centers. 
They  are  differentiated  according  to  whether  the  testing  is 
performed  before  or  after  the  product  is  accepted  into  inventory. 
The  former  (i.e.,  programmatic  pre- acceptance  testing)  is 
discussed  in  Section  4.2.1,  below.  The  latter  (i.e., 
programmatic  post  acceptance  testing)  is  discussed  in  Section 
4.2.2. 


The  third  category  consists  of  handling  and  shipping  costs  that 
are  avoided  when  testing  is  performed  by  a  DLA  laboratory 
collocated  with  a  depot  that  supplies  the  tested  items.  This  is 
discussed  in  Section  4.2.3. 


Costs  avoided  because  tests  performed  by  DLA  in-house 
laboratories  are  not  performed  by  non-DLA  governmental  or 
commercial  laboratories  are  not  included.  From  the  standpoint  of 
an  individual  laboratory  this  is  an  element  of  return.  However, 
from  the  standpoint  of  the  entire  DLA  laboratory  testing  program, 
it  is  a  cost  avoidance  attributable  to  having  in-house 
leJsoratories  rather  than  a  return.  Appendix  C  shows  the 
magnitude  of  this  cost  avoidance. 

4.2.1  FROM  PROGRAMMATIC  PRE -ACCEPTANCE  TESTING 

This  category  refers  to  cost  avoidance  as  a  result  of  testing  of 
items  before  they  are  received  into  inventory.  It  includes  tests 
of  samples  of  items  taken  at  vendor  plants  (e.g.  at  DESC  the 
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program  known  as  TRISTAR)  and  at  depots  (i.e.  receiving 
inspections  for  destination  accepted  material) .  The  potential 
for  cost  avoidance  is  quite  large.  This  is  because  detection  and 
rejection  of  unsatisfactory  lots  at  this  stage  prevent  all  of  the 
non- conforming  parts  from  reaching  DLA  customers. 

The  parameters  used  to  estimate  this  type  of  cost  avoidance  are 
as  follows: 

As  Number  of  lots  rejected. 

Bs  Average  number  of  items  per  lot. 

Cs  Number  of  items  tested  in  lots  rejected. 

Ds  Number  of  items  failed  in  lots  rejected. 

Es  Number  of  items  failed  in  lots  accepted. 

Fs  Average  cost  to  the  Government  (i.e.,  DLA  customers)  of  repairing 
equipnent  damaged  because  of  non-conforming  items  supplied  by  DLA. 

Gs  Total  cost  of  non- conforming  items  in  lots  rejected  and  items 
rejected  in  lots  accepted. 

Given  estimates  of  the  parameters  listed  above,  cost  avoidance  is 
estimated  to  be  (£  x  A  x  B  +  E)F  G 

C 

Three  supply  centers,  DESC,  DISC,  and  DPSC  (C&T) ,  did  a 
sxibstantial  amount  of  pre- acceptance  testing  in  FY  92.  Estimates 
of  the  costs  avoided  are  provided  in  Table  4-1.  Appendix  B.l 
shows  the  derivation  of  the  estimates. 


Table  4-1.  ESTIMATED  COST  AVOIDANCE  FROM  PROGRAMMATIC 
PRE -ACCEPTANCE  TESTING,  FY  92 

SUPBlY-  .Centgy  costs  Avoit^ancf*  ( 6000 ) 

DESC  $  21,040 

DISC  46 

DPSC  (C&T)  11.823 

TOTAL  $  32,909 

Two  major  qualifications  about  the  above  estimates 
must  be  clearly  understood.  Firstly,  they  are  proportional  to 
parameter  F,  the  average  cost  to  the  Government  of  repairing 
equipment  damaged  because  of  non-conforming  items  supplied  by 
DLA.  Yet  there  is  no  hard  data  on  this  parameter.  DESC  provided 
some  estimates  that  were  little  more  than  plausible  guesses.  The 
other  supply  centers  had  no  data  on  this,  so  estimates  provided 
by  DESC  were  used. 

Secondly,  supply  centers  varied  in  their  ability  to  provide  da^  ^ 
on  the  other  parameters.  DESC  provided  all  of  the  parameters  tor 
electronic  testing  but  did  not  provide  parameters  C,  D,  and  E  for 
other  testing.  DISC  did  not  provide  parameters  B  and  G. 

DPSC (C&T)  provided  no  data  on  parameters  D,  E,  and  G.  DCSC  and 
DGSC  did  not  report  any  pre -acceptance  testing.  (Their  data  on 
post -acceptance  testing  was  difficult  to  interpret  because  of 
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uncertainty  about  whether  items  in  failed  lots  were  withdrawn 
from  stock  (DCSC)  and  the  meanings  of  the  data  furnished  (DGSC) . ) 

In  the  absence  of  needed  data,  alternative  procedures  were  used 
to  estimate  cost  avoidance  from  pre- acceptance  testing  (see 
Appendix  B.l).  The  underlying  assumptions  are  listed  and  should 
be  noted. 


4.2.2  FROM  PROGRAMMATIC  POST  ACCEPTANCE  TESTING 

This  category  refers  to  cost  avoidance  as  a  result  of  testing  of 
items  after  they  are  received  into  inventory.  Cost  avoidance  may 
be  estimated  in  a  manner  similar  to  that  used  for  pre -acceptance 
testing  with  two  exceptions.  Firstly,  since  stock  in  accepted 
lots  may  be  difficult  to  trace  at  depots  and  some  may  have  been 
shipped  to  customers,  part  of  the  non- conforming  lots  will  never 
be  recovered.  To  compensate  for  this  it  is  assumed  that  50 
percent  of  the  items  in  non- conforming  lots  will  not  be 
recovered.  Secondly,  the  cost  of  non -conforming  items  in  lots 
rejected  and  items  rejected  in  lots  accepted  is  not  counted.  In 
some  cases  DLA  can  recover  costs  through  voluntary  refunds, 
replacement,  or  warrantees,  but  this  cost  avoidance  is  expected 
to  be  minimal. 

The  parameters  used  to  estimate  this  type  of  cost  avoidance  are 
as  follows: 

As  Number  of  lots  rejected. 

B«  Average  number  of  items  per  lot. 

Cm  Number  of  items  tested  in  lots  rejected. 

Ds  Number  of  items  failed  in  lots  rejected. 

E=  Number  of  items  failed  in  lots  accepted. 

Fm  Average  cost  to  the  Government  (i.e.,  DLA  customers)  of  repairing 
equipment  damaged  because  of  non-conforming  items  supplied  by  DLA. 

Given  estimates  of  the  parameters  listed  above,  cost  avoidance  is 
estimated  to  be  (E  x  A  x  B  +  E)F  x  0.5. 

C 

Four  supply  centers,  DCSC,  DESC,  DGSC,  and  DISC,  did  a 
substantial  amount  of  post  acceptance  testing  in  FY  92.  Estimates 
of  the  costs  avoided  are  provided  in  Table  4-2.  Appendix  B.2 
shows  the  derivation  of  the  estimates. 

Table  4-2.  ESTIMATED  COST  AVOIDANCE  FROM  PROGRAMMATIC 
POST- ACCEPTANCE  TESTING,  FY  92 

Supply  Center  Costs  Avoidance ($000) 


DCSC 

$ 

495 

DESC 

1,221 

DGSC 

171 

DISC 

_ 

912 

TOTAL 

$ 

2,799 
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It  must  be  emphasized  that  the  foregoing  estimates  leave  much  to 
be  desired.  Firstly,  the  estimates  are  proportional  to  parameter 
F.  As  explained  in  Section  4.2.1  (above),  the  evidence 
supporting  the  data  is  very  soft.  Secondly,  DESC  was  the  only 
supply  center  for  which  the  desired  method  of  estimating  returns 
could  be  used  with  some  confidence.  It  was  necessary  to  use 
other  methods  for  the  other  supply  centers  (see  Appendix  B.2, 
footnote  3) .  This  resulted  in  conservative  estimates  of  cost 
avoidances . 

4.2.3  HANDLING  AND  SHIPPING 

This  category  refers  to  handling  and  shipping  costs  that  are 
avoided  when  testing  is  performed  by  a  DLA  laboratory  collocated 
with  a  depot  that  supplies  the  tested  items.  The  handling  costs 
that  are  avoided  are  the  costs  of  depot  Material  Release  Orders 
(MROs)  for  shipping  products  to  and  receiving  products  from 
outside  test  facilities  less  the  costs  of  depot  Informal  Material 
Accounting  System  (IMAS)  documents  for  issuing  products  to  and 
receiving  products  from  the  collocated  test  facilities.  The 
shipping  costs  that  are  avoided  are  the  costs  of  shipping 
products  to  outside  test  facilities  and  return  via  commercial 
carriers . 

Estimates  of  both  types  of  costs  were  documented  in  the  report 
entitled  "Analysis  of  DLA's  Quality  Assurance  Testing 
Laboratories,"  DLA-92-P10146,  prepared  by  the  DLA  Operations 
Research  and  Economic  Analysis  Office,  October  1991.  For  this 
report  the  estimates  contained  in  the  earlier  report  were 
updated.  Specifically,  handling  costs  (i.e.,  MROs  and  IMASs) 
were  increased  by  8.32  percent  to  reflect  increases  in  federal 
pay  schedules  between  FY'  90  and  FY  92.  Shipping  costs  were 
updated  to  reflect  average  overnight  shipping  costs  for  the 
second  and  third  quarters  of  FY  92  and  ground  transportation 
rates  on  file  as  of  February  1993. 

Estimates  of  the  costs  avoided  for  each  DLA  in-house  laboratory 
collocated  with  a  depot  are  provided  in  TeUsle  4-3.  Appendix  B.3 
shows  the  derivation  of  the  estimates. 


TABLE  4-3.  ESTIMATED  HANDLING  AND  SHIPPING  COST  AVOIDANCE,  FY  92 


DCSC 

DDRE 

DDRW 

TOTAL 
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4.2.4 


SUMMARY 


Table  4-4  provides  a  summary  of  the  quantitative  measures  of 
return  for  FY  92,  as  described  above. 


TABLE  4-4.  SUMMARY  OF  QUANTITATIVE  MEASURES  OF  RETURN,  FY  92  (000) 


Pr  oarauima  tic 

Handling 

and 

Pre -Acceptance 

Post -Acceptance 

Activity 

Testina 

Testina 

ShioDina 

Total 

DCSC 

$ 

$  495 

$  24 

$  519 

DESC 

21,040 

1,221 

- 

22,261 

DGSC 

- 

171 

- 

171 

DISC 

46 

912 

- 

958 

DPSC:CtT 

11,823 

- 

- 

11,823 

DDRE 

- 

- 

1 

1 

DDRH 

- 

35 

35 

TOTAL 

$32,909 

$2,799 

$  60 

$35,768 

4.3  OffltfimyEgB  ..fflPICftgQRS 

Laboratory  testing  is  an  essential  part  of  the  acquisition 
process.  The  benefits  probably  are  best  tinderstood  in 
qualitative  terms.  Some  of  them  are  described  below. 

4.3.1  VENDOR  MOTIVATION 

The  knowledge  that  products  may  be  tested  motivates  vendors  to 
provide  an  acceptable  product.  In  part,  this  is  because  failure 
of  a  product  to  pass  tests  will  result  in  non-payment  of 
invoices.  Even  worse,  it  may  result  in  legal  expenses,  fines, 
penalties,  and  fraud  convictions.  DISC  reported  56  contractor 
debarments  and  22  contractor  convictions  as  a  result  of 
IcOaoratory  testing  for  the  period  FY  87-92.  DCSC  reported  20 
contractor  debarments /separations  supported  by  Icd^oratory  testing 
during  the  last  3  years.  Moreover,  the  results  of  lcd?oratory 
testing  affect  the  ability  of  vendors  to  obtain  new  contracts. 

For  example,  an  Automated  Best  Value  Model  (ABVM)  and  the 
Contractor  Assessment -Product  Evaluation  (CAPE)  program  are 
designed  to  insure  that  vendors  which  consistently  provide 
acceptcible  products  receive  favorable  consideration  in  contract 
awards.  Results  of  laboratory  tests  are  essential  inputs  to  ABVM 
and  CAPE. 

4.3.2  CUSTOMER  SERVICE 

The  improved  quality  resulting  from  ledjoratory  testing  results  in 
much  better  customer  service.  Since  DLA  ships  fewer 
non -conforming  parts,  its  customers  have  fewer  equipment 
breakdowns  due  to  faulty  parts.  Consequently,  customers  need  to 
make  fewer  potentially  expensive  equipment  repairs.  More 
in^jortantly,  military  readiness  is  improved.  Missions  can  be 
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carried  out  more  successfully,  with  less  loss  of  material, 
equipment,  and  life. 

4.3.3  IMAGE 

Improved  customer  service  enhances  DLA's  image  with  its 
customers.  This  provides  many  intangible  benefits  (e.g.,  pride 
in  work,  employee  morale) .  One  tangible  benefit  is  that  the 
number  of  Product  Quality  Deficiency  Reports  (PQDRs)  probably 
goes  down.  The  savings  is  addressed  in  a  report  entitled, 
"Administrative  and  Holding  Costs  Resulting  from  Processing 
Reports  of  Nonconforming  Supplies,"  DLA-89-P81012 ,  prepared  by 
the  DliA  Operations  Research  and  Economic  Analysis  Office,  July 
1989.  It  showed  that  the  cost  to  DLA  of  a  typical  PQDR  includes, 
as  a  minimum,  administrative  costs  of  $501  and  holding  costs  of 
3.55  percent  of  the  contract  value. 

4.3.4  INVENTORY  COSTS 

The  improved  quality  resulting  from  laboratory  testing  means  that 
customers  return  less  product,  stockouts  due  to  faulty  product 
are  reduced,  lead  times  for  receipt  of  acceptable  products  are 
more  dependable,  and  inventory  can  be  controlled  more 
effectively.  This  reduces  the  investment  in  inventory  required 
to  produce  a  given  level  of  customer  service. 

4.3.5  SHELF  LIFE  EXTENSIONS 

Laboratory  testing  sometimes  is  used  to  determine  whether  shelf 
lives  may  be  extended.  This  can  produce  large  savings  by 
avoiding  the  purchase  of  new  stock.  For  example,  DPSC  (Medical) 
reported  that  for  FY  92,  as  a  participant  in  the  DoD/FDA  Shelf 
Life  Extension  Program,  it  avoided  purchases  of  over  $13  million 
at  a  cost  for  testing  of  $285,000.  (DoD  wide  purchases  of  over 
$76  million  were  avoided  for  a  testing  cost  of  $1,233,000.) 

4.3.6  REIMBURSEMENTS 

Laboratory  testing  frequently  enables  DLA  to  obtain  large 
reimbursements  from  vendors  who  supply  non- conforming  products. 
For  example,  DCSC  reported  receiving  over  $11  million  as  a  result 
of  legal  actions  over  the  period,  FY  90-92.  DISC  reported 
receiving  $3  million  as  a  result  of  legal  actions  over  the 
period,  FY  87-92.  In  addition,  it  received  $17  million  in 
voluntary  reimbursement  from  one  con^jany  last  year. 

4.3.7  CYCLE  TIME 

The  availability  of  in-house  laboratories  keeps  test  cycle  times 
(i.e.,  elapsed  time  between  initiation  of  test  plans  and 
evaluation  of  test  results)  low.  DCSC  and  DPSC  (C&T)  reported 
that  their  in-house  lcd>oratories  had  much  lower  cycle  times  than 
non-DLA  laboratories.  This  benefit,  although  difficult  to 
quantify,  is  important  to  supply  management  effectiveness. 
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4.3.8 


SUMMARY 


The  preceding  quantitative  summary  identified  returns  from  the 
laboratory  testing  program  in  FY  92  of  about  $36  million.  The 
qualitative  indicators  of  return  from  laboratory  testing  are  far 
more  important  than  the  quantitative  indicators.  Laboratory 
testing  motivates  vendors  to  provide  better  products.  This  means 
that  DLA  customers  have  fewer  equipment  breakdowns.  Hence, 
military  missions  can  be  carried  out  more  succesfully  with  less 
loss  of  material,  equipment,  and  life.  Moreover,  DLA  customers 
need  make  fewer  costly  equipment  repairs.  DLA  can  better  control 
its  investment  in  inventory.  Also  DLA  receives  siibstantial 
reimbursements  from  vendors,  both  voluntarily  and  from  legal 
actions,  as  a  result  of  laboratory  testing. 
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SECTION  5 
CONCLUSIONS 


This  report  provides  a  methodology  for  measuring  the  investment 
in  the  DLA  laboratory  testing  program.  The  data  needed  to 
support  the  measurements  of  investment  for  FY  92  were  readily 
available  only  from  DESC  and  DDRW.  Various  estimation  procedures 
had  to  be  used  for  the  other  supply  centers  and  DLA  laboratories. 
Nevertheless,  the  estimates  are  believed  to  be  reasonably  good. 
They  indicate  that  the  investment  in  the  DLA  laboratory  testing 
program  in  FY  92  was  about  $12  million. 

This  report  provides  a  methodology  for  measuring  some  types  of 
returns  from  the  DLA  laboratory  testing  program.  Much  of  the 
data  needed  to  support  the  measurements  of  return  for  FY  92  was 
either  obtainable  only  with  great  difficulty  or  not  available  at 
all .  Data  meanings  and  availabilities  differed  greatly  between 
supply  centers  and  DLA  laboratories.  Data  problems  were  least 
severe  at  DESC  and  the  two  distribution  region  laboratories. 

Data  problems  at  the  other  supply  centers  led  to  assumptions 
which  make  detailed  use  of  the  estimates  highly  undesirable.  The 
quantitative  measures  of  return  developed  in  this  report  indicate 
that  the  return  from  the  laboratory  testing  program  in  FY  92  was 
od)out  $36  million.  Most  of  the  return  is  a  cost  avoidance 
associated  with  prevention  of  costs  to  customers  for  installing 
and  replacing  defective  parts. 

Use  of  the  quantitative  indicators  of  return  shown  in  this  report 
to  compare  different  supply  centers  would  be  unfair  and 
misleading.  There  are  several  reasons  for  this.  Firstly,  the 
measures  shown  are  biased  on  the  conservative  side.  Secondly, 
the  types  of  testing  performed  and  the  use  of  the  results  vary 
greatly  between  supply  centers  and  led>oratories .  Thirdly,  there 
are  important  differences  in  the  meaning  of  the  data  furnished  by 
the  different  supply  centers.  For  these  reasons  the  biases  in 
the  measures  shown  are  not  consistent  between  supply  centers. 

The  qualitative  indicators  of  return  are  far  larger  and  more 
important  than  the  quantitative  indicators.  The  total  return 
(quantitative  plus  qualitative)  from  the  DLA  laboratory  testing 
program  is  a  large  multiple  of  the  annual  investment  in  it. 

Thus,  the  annual  return  on  investment  was  highly  favorable  in  FY 
92.  Since  FY  92  was  the  first  year  of  the  program  at  some 
locations,  resulting  in  some  high  nonrecurring  investment  costs, 
future  return  on  investment  should  be  more  favorable. 

The  principal  returns  from  the  Icdioratory  testing  program  are 
associated  with  supply  center  functions  (e.g.,  ordering  tests, 
using  test  results)  rather  than  laboratory  functions  (i.e., 
conducting  tests) .  These  benefits  accrue  regardless  of  where  the 
tests  are  performed.  The  returns  on  investment  from  in-house 
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laboratories,  particularly  those  not  located  at  supply  centers, 
are  much  lower.  The  return  from  DDRE  in  FY  92  was  especially 
low,  reflecting  the  fact  that  it  was  being  developed  during  the 
year,  was  opened  near  the  close  of  the  year,  and  was  seriously 
under  utilized. 

At  some  locations  (e.g.,  DCSC,  DESC,  DPSC  (C&T) )  the  DLA  in-house 
laboratories  are  an  integral  part  of  the  laboratory  testing 
program  of  the  supply  centers.  There  is  no  simple  way  of 
separating  their  costs.  This  makes  it  impossible  to  develop 
return  on  investment  models  for  DLA  in-house  laboratories 
separate  from  the  laboratory  testing  program  of  the  supply 
centers  which  they  support.  However,  this  will  change  with  the 
administrative  changes  planned  for  FY  94  (i.e.,  in-house 
laboratories  becoming  independent  of  supply  centers  and  funded  on 
a  fee  for  service  basis) .  Development  of  return  on  investment 
models  for  DLA  in-house  laboratories  separate  and  distinct  from 
the  laboratory  testing  program  at  supply  centers  should  become 
feasible. 
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SECTION  6 
RECOMMENDATIONS 


DLA  should  consider  steps  to  standardize  terminology  and 
procedures  for  reporting  workload  and  cost  data  so  that  the  costs 
of  and  results  generated  by  the  laboratory  testing  program  at  all 
supply  centers  and  DLA  laboratories  can  be  examined  on  a  common 
basis.  The  data  elements  used  in  this  report  provide  a  useful 
starting  point. 

DLA  should  consider  undertaking  further  research  to  measure  the 
cost  to  its  customers  of  receiving  items  from  DLA  which  do  not 
meet  specifications.  For  example,  the  probability  of  equipment 
failure  and  subsequent  cost  of  repairing  damaged  equipment  caused 
by  non -conforming  products  supplied  by  DLA  needs  to  be  better 
understood. 

DLA  should  consider  measuring  the  return  on  investment  from  the 
la’  ratory  testing  program  for  FY  93  and  subsequent  years  using 
the  methodology  described  in  this  report.  This  will  provide 
visibility  on  trends  and  a  basis  for  identifying  futher  research 
and  opportunities  for  improvement.  Beginning  in  FY  94,  when  the 
DLA  in-house  laboratories  become  independent  of  supply  centers 
and  their  funding  on  a  fee -for- service  basis  is  initiated, 
separate  measures  of  return  on  investment  for  DLA  in-house 
l^>oratories  and  the  laboratory  testing  program  at  supply  centers 
would  be  desirable. 

DLA  should  consider  a  follow-on  study  of  the  economics  of  using 
commercial  ledsoratories  in  lieu  of  DLA  in-house  laboratories. 

Such  a  study  would  be  appropriate  when;  (a)  more  information  on 
ledsoratory  testing  costs  and  return  is  available,  (b)  there  has 
been  some  experience  with  funding  in-house  laboratories  on  a  fee 
for  service  basis,  (c)  relocation  of  the  in-house  ladaoratories  at 
DESC  and  DPSC(C&T)  becomes  necessary  because  of  Base  Realignment 
and  Closure  1993 . 
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APPENDIX  A 

ESTIMATES  OF  INVESTMENT  FOR  FY  92 


Reimbursements,  DLA 


'  Directly  from  source  (supply  center,  DDR  laboratory,  or  HQ  DLA,  as  appropriate). 

*  Labor  costs  from  source  multiplied  by  1 .2955  (factor  furnished  by  HQ  DLA  CAIL/Economic  Analysis  Team)  to  account 
for  fringe  benefits. 

’  Labor  costs  from  source  multiplied  by  1.20  (factor  furnished  by  HQ  DLA  CAIL/Economic  Analysis  Team  to  account  for 
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APPENDIX  B.1 

ESTIMATES  OF  RETURN  BY  SUPPLY  CENTER,  FY  92 
PROGRAMMATIC  PRE-ACCEPTANCE  TESTBVG 


APPENDIX  B.2 

ESTIMATES  OF  RETURN  BY  SUPPLY  CENTER,  FY  92 
PROGRAMMATIC  POST  ACCEPTANCE  TESTING 


1.  For  DGSC  return  was  assumed  to  be  DxF  because  the  data  provided  on  lot  size  had  a  dirterent 

herein,  . 

For  DISC  return  was  assumed  to  be  AxF  because  there  was  no  information  on  average  lot  size. 


APPENDIX  B.3 

ESTIMATES  OF  RETURN  BY  DLA  LABORATORY,  FY  92 
HANDLING  AMD  SHIPPING 


Avg  Costs  per  Test 

Handling 

(1) 

MRO,  Shipping 

MRO,  Receiving 

(2) 

Total 

(3) 

XMAS,  Shipping 

(4) 

XMAS,  Receiving 

(5) 

Total 

(6) 

Net  Savings 

(7) 

Shipping 

(8) 

One  Nay 

Round  trip 

(9) 

Total  Net  Savings 

(10) 

Mvuiiber  of  Tests  Conducted  (11) 
Total  Savings  (12) 


DCSC 

PPRE 

$  5.741 

$  5.448 

IQ. 973 

12.021 

(l)  +  (2) 

$16-714 

$17,569 

1.462 

1.495 

3.401 

-  2^11 

(4)  +  (5) 

&  4.863 

S  4.409 

(3)-(6) 

$11,851 

$13,160 

$10,978 

$10,932 

2x(8) 

,  21.95.Q 

2U9S4 

(7)  +  (9) 

$33,807 

$35,024 

714 

19 

(lO)x(ll) 

$24,138 

$  665 

DDRW 


$  6.055 

$20,862 

1.679 

$14,579 


$11,259 

22.518 

$37,097 

954 

$35,391 
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APPENDIX  C 

EXTERNAL  LABORATORY  TESTING 


Return  on  investment  for  a  DLA  in-house  laboratory  on  a  stand 
alone  basis  is  not  apparent  from  the  data  given  elsewhere  in  this 
report.  In  particular,  the  cost  of  operating  a  laboratory  is  the 
cost  before  reimbursements.  Thus,  the  relevant  investment 
figures  for  laboratories  which  are  independent  of  supply  centers 
(i.e.,  DDRE  and  DDRW)  are  the  costs  before  reimbursements. 

Returns  for  such  laboratories  include : 

1.  Handling  and  shipping  costs  that  are  avoided  when  testing  is 
performed  by  a  DLA  laboratory  collocated  with  a  depot  that 
supplies  the  tested  items  (addressed  in  Section  4.2.3  of  this 
report) . 

2.  Reimbursements  received  for  tests  performed  for  non-DLA 
requesters  (addressed  in  Section  3.9  of  this  report  as  a  cost 
deduction) . 

3 .  Costs  avoided  because  tests  performed  by  DLA  in-house 
laboratories  otherwise  would  have  been  performed  by  non-DLA 
governmental  laboratories  or  by  commercial  laboratories.  This  is 
a  major  item  not  addressed  elsewhere  in  this  report.  Estimates 
for  FY  92  are  provided  below. 

An  estimate  of  the  external  laboratory  testing  cost  avoidance  per 
test  may  be  based  upon  the  average  cost  of  tests  by  commercial 
laboratories  and  non-DLA  governmental  laboratories  as  reported  by 
the  DLA  supply  centers  for  FY  92.  Table  C-1  shows  the  numbers 
provided.  The  average  cost  of  $1,096  per  test  was  assumed  to  be 
an  appropriate  estimate  of  costs  avoided  because  of  tests 
conducted  at  all  DLA  in-house  laboratories.  Admittedly,  this 
ignores  significant  differences  in  the  nature  of  the  tests 
conducted . 
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TABLE  C-1 .  COSTS  FOR  NON-DLA  LABORATORIES.  FY  92 


Total  Cost 

Average  Cost 
Per  Test 

CommCTcial 

Laborawrics 

DCSC* 

30 

$  19,351 

$  645 

DESC 

67 

38,890** 

580 

DISC 

1.402 

.  L583.345 

JLJ22 

Subtotal 

1,499 

$1,641,586 

$1,095 

Governmental 

Laboratories 

DCSC* 

107 

36,632 

342 

DGSC 

118 

120,632 

1,022 

DISC 

889 

656,900 

739 

DPSC:C&T 

800.000 

-2^41 

Subtotal 

1,471 

$1,614,164 

$1,097 

GRAND  TOTAL 

2,970 

$3,255,750 

$1,096 

*  DCSC  for  30  April  92-31  March  93. 

**  DESC  costs  for  tests  made  in  FY  92  rather  than  expenses  recorded  for  FY  92. 


Estimates  of  the  costs  avoided  for  each  DLA  in-house  laboratory 
are  provided  in  Table  C-2.  The  large  cost  avoidance  shovm  for 
DPSC(C&T)  may  be  inflated  due  to  the  assumption  of  equal  costs 
per  test  discussed  edjove. 

TABLE  C-2.  ESTIMATED  COST  AVOIDANCE  FOR  EXTERNAL  LABORATORY 

TESTING,  FY  92 


DLA 

Number  of 

Return  f  Costs  Avoided^ 

Labggtftiy 

Twte  Pffrfbnngd 

Per  Test 

Total  (000^ 

DCSC 

752 

$1,096 

$  824 

DESC 

2,507 

1,096 

2,748 

DPSC(C&T) 

4,451 

1,096 

4,878 

DDRE 

44 

1,096 

48 

DDRW 

1.366 

_LQ26 

AJSl 

TOTAL 

9,120 

$1,096 

$9,995 
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APPENDIX  E 
POINTS  OF  CONTACT 


The  principal  point  of  contact  for  each  location  which  furnished  the  data  used  in  this  report  is 
shown  below: 

DLA  Headquarters 

Mr.  Alex  Melnikow 
Action  Officer,  Product  Conformance 
DSN  667-0505 

SarolY 
DCSC 

Mr.  John  Copeland 
Chief,  Test  Facility 
DSN  850-3589 

DESC 

Mr.  Brian  McNicholl 
Chief,  Test  Facility 
DSN  986-6964 

DGSC 

Mr.  Charles  Bates 
Chief,  Testing 
DSN  695-3598 

DISC 

Ms.  Mickie  Joyce 
Manager,  CAPE  Program 
DSN  442-0564 

DPSC(C&T) 

Mr.  Algie  L.  Manuel 
Assistant  Chief,  Quality 
DSN  444-3241 


Distribution  Regions 
DDRE 

Mr.  Michael  N.  Yakubick 
Chief,  Test  Laboratory 
DSN  977-4098 

DDRW 

Mr.  David  Clarimo 
Chief,  Test  Laboratory 
DSN  462-2631 
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APPEHDIX  F 

ANALYTICAL  SERVICE  AOREEMEMT 


AHALYTIC  BBRVICBB  AGREEMENT 
DEFENBB  LOOIBTICB  AGENCY  (DLA)  LABORATORY  TEBTING 
RETURN  ON  INVESTMENT  (ROZ)  MODEL 
DLA-ZX-P20253 


SECTION  1  -  STUDY  DESCRIPTION 

1.1  PROBLEM  STATEMENT.  DLA's  Quality  Assurance 
Directorate  (OLA-QL)  management  requires  a  sound 
approach  for  measuring  the  returns  (value  added)  from 
its  laboratory  testing  program. 

1.2  OBJECTIVES. 

1.2.1  Develop  a  methodology  for  measuring  DLA 
investments  in  and  returns  from  its  laboratory 
testing  program. 

1.2.2  Develop  initial  measures  of  DLA  investments  and 
returns  from  its  laboratory  testing  pro^am. 

1.2.3  Provide  DLA  management  with  the  capability  to 
run  "what  if"  simulations  on  the  financial 
impacts  of  chemges  in  workload  levels,  use  of 
in-house  vs  outside  laboratories,  new 
investments  in  laboratory  facilities,  expanded 
or  curtailed  lab  testing  programs,  etc. 

1.3  BACKGROUND. 

1.3.1  Dxiring  the  past  year  DLA  greatly  stren^hened 
its  laboratory  testing  progreus.  This  included 
increased  emphasis  on  inspecting  items  as  they 
are  received  at  depots,  monitoring  the  quality 
of  depot  stocks,  and  verifying  conformance  of 
items  before  they  leave  vendor  plants 
(eg.  TRISTAR  program) .  Also  substantial 
investments  were  made  in  DLA  in-house 
laboratory  testing  facilities. 

This  study  builds  upon  DLA-XX-P10146,  "Analysis 
of  DLA's  Quality  Assurzmce  Testing 
Laboratories,"  published  as  a  "white  cover" 
report  in  December  1991. 


The  study  will  include  financial  investments 
(costs  incurred)  and  f.inancial  returns  to  DLA 
and  its  customers  from  the  agency's 
LedMratory  Testing  Program  at  all  DLA  supply 
centers  (except  the  Defense  Fuel  Supply 
Center)  emd  Distribution  Region  laboratories. 
Costs  charged  to  DLA  supply  centers  for  tests 
run  at  non-DLA  government  and  commercial 


1.3.2 

1.4  SCOPE. 

1.4.1 

1.4.2 
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laboratories  will  be  included  in  the  costs  of 
the  supply  centers. 

1.4.3  Initial  measures  of  DLA  investments  and  returns 
from  its  lab  testing  program  will  cover  FY  92. 
Time  series  data  will  cover  future  periods  as 
it  becomes  available. 


SgCTIQN  2  -  STUDY  APPROACH 


2.1  hKALYTICAL  TBCEHIQnES  APPLIED. 

2.1.1  A  flow  chart  will  be  developed  which  defines 
the  scope  and  operational  processes  of  the  DLA 
Lab  Testing  Program.  This  chart  will  provide 
the  fotindation  for  soibseguent  analyses. 

2.1.2  The  total  cost  of  the  DLA  lab  testing  progreun 
for  FY  92  by  location  will  be  developed.  This 
will  include: 


2. 1.2.1 

2. 1.2. 2 

2. 1.2. 3 

2. 1.2. 4 


The  total  cost  of  operating  DLA 
laboratory  testing  facilities, 
including  labor,  other  operating 
costs,  maintenance,  and  depreciation. 
Costs  of  non-DLA  government  and 
commercial  laboratories  used  in 
support  of  the  DLA  laboratory  testing 
program. 

Cost  of  the  Quality  Assurance  Test 
Division  of  each  supply  center  (or 
whichever  division  accomplishes  this 
function) . 

Applicable  costs  of  the  Laboratory 
Testing  Team  at  HQ  DLA. 


2.1.3  A  comprehensive  list  of  guzmtitative  and 
cpialitative  benefits  from  the  DLA  laboratory 
testing  program  will  be  developed. 

2.1.4  Measxires  of  return  from  the  DLA  laborato:^ 
testing  program  for  each  supply  center  will  be 
developed  and  analyzed.  These  measures  will  be 
in  the  form  of  time  series  spemning  several  (up 
to  ten)  years.  They  will  include  at  least  the 
following: 


2. 1.4.1  Nonconformity  rates  for  product 
received. 

2. 1.4. 2  Numbers  of  product  Quality  Deficiency 
Reports  submitted  by  the  services, 

DLA  activities,  and  from  previously 
completed  led>  tests. 

2. 1.4. 3  Total  dollars  collected  from  vendors 
(reimbursements)  as  a  compensation 
for  supplying  non-confoirming  product. 
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2.1.5  A  comprehensive  laboratory  testing  cost 

avoidance  model  will  be  developed  which  results 
in  data  to  satisfy  the  study  objectives. 
Characteristics  of  the  model  include: 

-  Tangible  measures  of  both  investments  (costs 
actually  incurred)  and  returns  (costs 
avoided) . 

-  Scope  is  limited  primarily  to  the 
discretioneury  portion  of  the  lab  testing 
program.  Directed  testing,  by  its  nature, 
does  not  result  in  true  cost  avoidances 
because  there  is  no  alternative  to  testing. 

In  other  words,  because  the  testing  is 
mandated,  benefits  will  be  accrued  whether 
or  not  other  testing  is  accomplished. 

-  Modules  for  each  supply  center  and  DLA 
Distribution  Region  laboratory. 

-  Use  the  Defense  Electronics  Supply  Center 
(DESC)  Cost  Avoidance  Model  as  the  initial 
point  of  depzurture  for  model  development. 

Investments  used  will  be  the  portions  of  total 
OLA  laboratory  testing  program  costs  (para 
2.1.2)  that  relate  to  discretionary  progreuns. 
Retxirns  measiured  will  include  at  least  the 
following: 

-  Avoidance  of  costs  to  repair  equipments  by 
DLA  emd  its  customers  due  to  detection  of 
non-conforming  lots  and  faulty  parts ._ 

-  Avoidance  of  costs  to  replace  parts  due  to 

detection  of  non-conforming  lots  and  faulty 
peurts.  i 

-  Net  savings  due  to  the  use  of  DLA  labs  in 
lieu  of  non-DLA  government  and  commercial 
labs  for  required  testing. 

-  AvoidMce  of  shipping  costs  when  items 
tested  9XB  taken  from  depots  collocated  with 
the  DLA  test  labs. 

-  Avoidance  of  depot  handling  costs  when  items 
tested  eure  tzdcen  from  depots  collocated  with 
the  DLA  test  labs  or  are  tested  at  vendors' 
plants  (TRISTAR  program) . 
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Reimbursenen't  for  lab  -  tests  performed  for 
other  agencies  (e.g.  Army,  Navy,  Air  Force, 
NASA,  etc.)* 


2.2  SPECIAL  RSQUIRSKBIITS.  The  project  will  require 

extensive  data  collection. 

2.2.1  DLA-QL  and  DORO  jointly  will  develop  the 
definitions  of  the  data  required. 

2.2.2  DLA-QL  will  be  responsible  for  instiring  that 
data  needed  are  provided  in  a  timely  manner. 

2.2.3  DLA-QL  and  DORO  jointly  will  visit  supply  - 
centers  and  DLA  labs  as  required. 

2.2.4  DLA-QL  will  be  responsible  for  maintaining  the 
cost  avoidance  model. 


SECTION  3  -  DELZVERABLES 

3.1  Monthly  progress  repozrts. 

3.2  Flow  chart  of  DLA  Lab  Testing  process ^ 

3.3  Measiires  of  total  costs  of  DLA  lab  testing  program  by 
supply  center  and  distribution  region  laboratory. 

3.4  List  of  quantitative  and  qualitative  benefits  of  DLA 
Lab  Testing  Progreun. 

3.5  Measures  of  returns  over  time  with  analysis  by  supply 
center. 

3.6  Comprehensive  lab  testing  cost  avoidance  model  with 
modules  for  each  supply  center  and  laboratory  facility 
and  with  measures  for  FY  92. 

3.7  Documentation  (User's  Guide)  for  cost  avoidzmce  model. 

3.8  Final  briefings 

3.9  Final  written  report. 


eECTXQN  4  -  MILB8T0ME8 


4 . 1  ASA  approval 

4.2  Deliver  flow  chart 

4.3  Flow  chart  decision 

4.4  Define  data  requirement? 

4.5  Data  requests  to  all  data  sources 

4.6  Receipt  of  all  data 

4.7  In-Process  Review 

4.8  Deliver:  Measures  of  total  co?t 
List  of  benefits 

.Measures  of  returns  overtime 
Model  modules  for  DDRE  lab 
Model  Modules  for  DDRW  lab 

4.9  Complete  model  modules  for  DESC 
Complete  model  modules  for  DCSC 


Organization 
Primarily  Responsible 

LO/DORO  DLA-QL _ 

1  Jan  93 


15 

Jan 

93 

31 

Jan 

93 

15 

May 

93 

15 

May 

93 

15 

May 

93 

15 

May 

93 

15 

May 

93 

15 

May 

93 

31 

May 

93 

30 

Jun 

93 

15  Jan  93 
31  Jan  93 
15  Feb  93 
15  Apr  93 
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Complete  model  modules  for  DISC 
Complete  model  modules  for  DGSC 
Complete  model  modules  for  DPSC, 
C&T,  Medical,  Subsistence 

4.10  Deliver  final  production  model 

with  documentation 

4.11  Final  brief  to  sponsor 

4.12  Draft  Repozrt 

4.13  Final  Report 

4.14  Anticipated  Level -of -Effort: 


31  Jul  93 
15  Aug  93 
31  Aug  93 

30  Sep  93 

30  Sep  93 
15  Oct  93 
30  Nov  93 

1350  hours  equating  to  a 
cost  of  approximately 
$78,300. 
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5.1  SPONSORING  ORGANIZATION  POCs 


DLA-QL  Contact; 

COL  Levi  D.  Lowman,  Jr., 

USAF 

Chief,  Laboratory  Testing 
Study  Sponsor 

Teeun 

Phone: 

(DSN)  284-4127 

FAX: 

(DSN)  284-4498 

Contact: 

Major  Sarah  Satterfield, 
Action  Officer 

USA 

Phone : 

(DSN)  284-6456 

FAX: 

(DSN)  284-4498 

Contact: 

Mr.  Paul  LaiBute 

Action  Officer 

Phone : 

(DSN)  284-6456 

FAX: 

(DSN)  284-4498 

PERFORMING  ORGANIZATION  POCs. 

OLA-LO  Contact: 

Mr.  Jim  Russell 

Senior  Study  Director, 
Acquisition  Management 

Phone: . 

(DSN)  284-7227 

FAX: 

(DSN)  284-3831 

DLA-DORO  Contact: 

MAJ  Mark  Melius,  USA 

Lead  Analyst 

Phone: 

(DSN)  695-5198 

FAX: 

(DSN)  695-5319 

Contact : 

Mr.  Burnham  Gould 
Associate  Analyst 

Phone: 

(DSN)  695-4972 

FAX: 

(DSN)  695-5319 
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ANALYTIC  SERVICES  AGREEMENT 
DEFENSE  LOGISTICS  AGENCY  (DLA)  LABORATORY  TESTING 
RETURN  ON  INVESTMENT  (ROI)  MODEL 
DLA-XX-P202S3 


^OGER  C.  ROY 
Assistant  Director 
Policy  and  Plans 


T.C.  HRUSKOCy  BRIG  GEN,  USj|^\ 
Executive  Director  ’ 
Quality  Assurance 
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